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CLAIMS : 

What is claimed is: 

1. A method for monitoring responses to test questions 
presented in a data processing system, the method 
comprising the computer implemented steps of: 

identifying presentation of the test questions on 
the data processing system; 

responsive to the presentation of the test questions 
on the data processing system, monitoring test question 
timing data in which the test question timing data 
represents an elapsed time since an answered question 
from the test questions has been presented; and 

generating an alert after the test question timing 
data exceeds a threshold. 

2. The method of claim 1, wherein the monitoring step 
is performed by a proctor device or a program on the data 
processing system. 

3. The method of claim 2, wherein the program is an 
applet . 

4. The method of claim 1 further comprising: 

billing a client for monitoring the presentation of 
the test questions. 

5. The method of claim 1, wherein the test questions 
are part of a test and further comprising: 

storing an identification of a number of test takers 
for the test; and 
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billing a client based on the number of test takers 
for the test. 

6. A method of monitoring a test question response 
time, comprising the steps of: 
5 administering a test to a remotely located user of a 

client device; 

receiving test question timing data from the client 
device, the test question timing data representing an 
elapsed time used in attempting to answer the test 
10 question; and 

outputting the test question timing data to a 
proctor device such that the proctor device may monitor 
the elapsed time in attempting to answer the test 
question for the remotely located user. 



j B & 15 7. The method of claim 6, further comprising billing a 
;J test developer for administration of the test to the 

remotely located user. 

i 

Q 8. The method of claim 6, further comprising billing 

l * m the remotely located user for administration of the test. 

20 9. The method of claim 6, further comprising sending an 

instant message to the client device. 

10. The method of claim 6, further comprising receiving 
an instant message from the client device. 

11. The method of claim 6, further comprising 

25 alerting the remotely located user when the test question 
timing data exceeds a predetermined threshold. 



38 

Docket No. AUS920010507US1 

12. The method of claim 6, further comprising storing a 
score for the test in a permanent storage. 

13. The method of claim 6, wherein the test is developed 
by a test developer and wherein the method is implemented 

5 by a test administration system that is operated by a 
different entity from the test developer. 

14. The method of claim 6, further comprising: 
receiving a request for administration of the test 

to the remotely located user; 
10 establishing a session identification for the 

f'JJ administration of the test to the remotely located user; 

■iB and 

lV correlating the test question timing data to the 

1* administration of the test to the remotely located user 

15 based on the session identification. 

m 15. The method of claim 14 , wherein the session 

-si ffe? 

=^ identification includes a proctor device identifier, and 

£6 

g wherein outputting the test question timing data to the 

^ proctor device is based on the proctor device identifier. 

20 16. The method of claim 6, further comprising: 

storing an indicator of a number of test takers for 

the test; and 

billing a test developer of the test based on the 

number of test takers for the test. 



25 



17. The method of claim 6, further comprising: 

monitoring the test question timing data for 
evidence of greater than expected response time to the 
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test question, wherein outputting the test question 
timing data to a proctor device is performed in response 
to determining that evidence of greater than expected 
response time to the test question is present. 

18. The method of claim 16, wherein monitoring the test 
question timing data for evidence of greater than 
expected response time to the test question includes 
comparing previously received test question timing data 
to currently received test question timing data to 
determine if a change in the test question timing data 
indicates evidence of greater than expected response time 
to the test question, 

19. The method of claim 6, further comprising 
generating an alert profile for the remotely located user 
for a particular test based on at least one of a data 
profile associated with the remotely located user, an 
examination question timing database, and a degree of 
difficulty associated with a question on the test. 

20. The method of claim 19, further comprising 
transmitting an alert to the remotely located user based 
on the generated alert profile. 

21. The method of claim 19, further comprising storing a 
response from the remotely located user to update the 
alert profile for use in future tests. 

25 22. The method of claim 6, further comprising storing of 
the timing data for the test question to update timing 



10 



15 



20 
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data for the remotely located user for use in future 
tests . 

23. An apparatus for monitoring responses to test 
questions presented in a data processing system, the 

5 apparatus comprising: 

identifying means for identifying presentation of 
the test questions on the data processing system; 

monitoring means, responsive to the presentation of 
the test questions on the data processing system, for 
10 monitoring test question timing data in which the test 

question timing data represents an elapsed time since an 
answered question from the test questions has been 
presented; and 

generating means for generating an alert after the 
15 test question timing data exceeds a threshold. 

24. The apparatus of claim 23, wherein the apparatus is 
a proctor device or a program on the data processing 



liS system. 



25. The apparatus of claim 24, wherein the program is an 
20 applet . 

26. The apparatus of claim 23 further comprising: 
billing means for billing a client for monitoring 

the presentation of the test questions. 

27. The apparatus of claim 23, wherein the test 

25 questions are part of a test and further comprising: 
storing means for storing an identification of a 
number of test takers for the test; and 
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billing means for billing a client based on the 
number of test takers for the test. 

28. A data processing system comprising: 
a bus system; 

a communications unit connected to the bus system; 

a memory connected to the bus system, wherein the 
memory includes a set of instructions; and 

a processing unit connected to the bus system, 
wherein the processing unit executes the set of 
instructions to identify presentation of the test 
questions on the data processing system, monitor test 
question timing data in response to the presentation of 
the test questions on the data processing system in which 
the test question timing data represents an elapsed time 
since an answered question from the test questions has 
been presented, and generate an alert after the test 
question timing data exceeds a threshold. 

29. An apparatus for monitoring a test question response 
time, comprising: 

a controller; and 

at least one interface coupled to the controller, 
wherein the controller administers a test to a remotely 
located user of a client device via the at least one 
interface, receives test question timing data from the 
client device via the at least one interface, the test 
question timing data representing an elapsed time used in 
attempting to answer the test question, and outputs the 
test question timing data to a proctor device via the at 
least one interface, such that the proctor device may 
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monitor the elapsed time in attempting to answer the test 
question for the remotely located user. 

30. The apparatus of claim 29, wherein the controller 
bills a test developer for administration of the test to 

5 the remotely located user. 

31. The apparatus of claim 29, wherein the controller 
bills the remotely located user for administration of the 
test . 

32. The apparatus of claim 29, wherein the controller 
10 sends an instant message to the client device via the at 

least one interface. 

33. The apparatus of claim 29, wherein the controller 
receives an instant message from the client device via 
the at least one interface. 

15 34. The apparatus of claim 29, wherein the controller 
alerts the remotely located user when the test question 
timing data exceeds a predetermined threshold. 

35. The apparatus of claim 29, further comprising a 
storage device, wherein the controller stores a score for 

20 the test in the storage device. 

36. The apparatus of claim 29, wherein the test is 
developed by a test developer and wherein the apparatus 
is operated by a different entity from the test 
developer . 
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37. The apparatus of claim 29, wherein the controller 
receives a request for administration of the test to the 
remotely located user, establishes a session 
identification for the administration of the test to the 

5 remotely located user, and correlates the test question 
timing data to the administration of the test to the 
remotely located user based on the session 
identification. 

38. The apparatus of claim 37, wherein the session 

10 identification includes a proctor device identifier, and 
wherein the controller outputs the test question timing 
data to the proctor device based on the proctor device 
identifier. 

39. The apparatus of claim 29, further comprising a 
15 storage device, wherein the controller stores an 

indicator of a number of test takers for the test in the 
storage device and bills a test developer of the test 
based on the number of test takers for the test. 

40. The apparatus of claim 29, wherein the controller 
20 monitors the test environment data for evidence of 

greater than expected response time to the test question, 
and wherein the controller outputs the test question 
timing data to a proctor device in response to 
determining that evidence of greater than expected 
25 response time to the test question is present. 

41. The apparatus of claim 40, wherein the controller 
monitors the test question timing data for evidence of 
greater than expected response time to the test question 
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by comparing previously received test question timing 
data to currently received test environment data to 
determine if a change in the test question timing data 
indicates evidence of greater than expected response time 
5 to the test question. 

42. The apparatus of claim 29, further comprising 
generating an alert profile for the remotely located user 
for a particular test based on at least one of a data 
profile associated with the remotely located user, an 
examination question timing database, and a degree of 
difficulty associated with a question on the test. 

43. The method of claim 42, further comprising 
transmitting an alert to the remotely located user based 
on the generated alert profile. 

44. The method of claim 42, further comprising storing a 
response from the remotely located user to update the 
alert profile for future tests. 

45. The method of claim 29, further comprising storing 
of the timing data for the test question to update timing 
data for the remotely located user for future tests. 

46. A computer program product in a computer readable 
medium for monitoring a test question response time, 
comprising: 

first instructions for administering a test to a 
25 remotely located user of a client devices- 
second instructions for receiving test question 
timing data from the client device, the test question 



10 



15 



20 
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timing data representing an elapsed time used in 
attempting to answer the test question; and 

third instructions for outputting the test question 
timing data to a proctor device such that the proctor 
5 device may monitor the elapsed time in attempting to 
answer the test question for the remotely located user. 



47. A computer program product in a computer readable 
medium for use in monitoring responses to test questions 
presented in a data processing system, the computer 

10 program product comprising: 

first instructions for identifying presentation of 
the test questions on the data processing system; 

second instructions, responsive to the presentation 
of the test questions on the data processing system, for 
15 monitoring test question timing data in which the test 
question timing data represents an elapsed time since an 
answered question from the test questions has been 

presented; and 

third instsructions for generating an alert after 
20 the test question timing data exceeds a threshold. 

48. The computer program product of claim 47, wherein 
the second instructions are located in a proctor device 
or a program on the data processing system. 

49. The computer program product of claim 47 further 
25 comprising: 

fourth instructions for billing a client for 
monitoring the presentation of the test questions. 
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50. The computer program product of claim 47, wherein 
the test questions are part of a test and further 
comprising: 

fourth instructions for storing an identification of 
5 a number of test takers for the test; and 

fifth instructions for billing a client based on the 
number of test takers for the test. 



